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ABSTRACT 

Serving in a program evaluation at Cornell 
University's Center for International studies by holding the unique 
position of participating in three distinct capacities: first, as the 
administrator of the center's undergraduate program; second, as a 
teacher in one of its courses; and third, as a member of the 
evaluation team, functioning as an intellectual historian with the 
task of recreating the historical context of the undergraduate 
program, the evaluator reviews her progress. She focuses on 
disciplinary and professional realizations and changes. 
(Author/BJG) ^ 
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In this paper I shall detail some of the more significant 
impacts upon me resulting from my involvements in a rather extensive 
'program evaluation. I use the word involvements rather than involve- 
ment for, amongst all the speakers in this group, I hold the unique 
position of having participated in the evaluation in three distinct 
capacities: first, as the administrative coordinator of the-Center 
for International Studies* undergraduate, program; second, as a 
teacher in one of its courses; and third, as a member of the evalu- 
ation team, functioning as an intellectual historian with 'the task 
of recreating the historical context of the undergraduate program. 
Having intersected the evaluation as an administrator, a teacher, and 
a historian, the impacts were many and varied. Having functioned as 
both the evaluated and the evaluator, I had the experience of view- 
ing evaluation from both outside and in. My focus will be on two 
classes of impacts, the disciplinary and the professional, for the 
reason that it was in these two areas that the influence of the 
evaluation process upon me was greatest. 

During the academic year ,1972-73, I was a third-year grad- 
uate student in a doctoral program in history at Cornell University, 
where my major field of study was Modern European Intellectual His- 
tory. In the fall of 1972 I became coordinator of the Undergraduate 
Interdisciplinary Program in International Studies. On being inter- 



viewed for the positton, I was told my role would be largely admini- 
. s.trattv.a: handling., the, procedural,, paperwork side of offering, courses.. 
In addition, I was informed that CIS* experimental undergraduate 
interdisciplinary program in International, Studies would be undergo- 
ing an extensive evaluation this year, and it would be my job to 
serve as liaison between CIS and the evaluators, providing them with 
all the information they v/ould require on past, present, and fixture 
undergraduate courses in the program. 

Up until the time I assumed this position, my only ex- 
perience with evaluation was as an undergraduate student who, like ' 
other undergraduates, received questionnaires at the end of a semester 
for the purpose of course evaluation. I recall thinking then that 
this was a good procedure since it offered the potential of benefit- 
ing both future students taking the course and the professor giving 
it. Hov/ever, the extent of my Interest In and knowledge about the 
field of education evaluation did not reach beyond such questionnaires 
and a basic belief In the value of the evaluative enterprise. 

I first began to learn about the substarftive and methodo- 
logical aspects ftf evaluation-when, as program coordinator, I, along 
with the evaluator, Whiton Paine, sat in on the weekly staff meet- 
ings of the undergraduate course presented that fall. The evalua- 
tion's underlying assumptions, its techniques, and its goals were 
driven- home to me in a rather explicit way from the start. Since the 
evaluation met with sk<*pt1c1sm and resistance from a professor on 



this teaching team, tRe very nature of educattonal evaluation, its 
value,, validity, and the question of its interference or non- 
interference in the course undergoing its scrutiny, were being raised. 
It was as an administrator, then, that I was introduced to the field 
of educattonal evaluation; both tn concept and in che form of prac- ' 
tical application. And since in my role as administrative coordinator 
of the undergraduate program,! was at the service of the program's 
teachers, students, and evaluators and had sustained contact with all 
three, I was sensitized to their Varying attitudes toward and reac- 
tions to the evaluation. 

As my role shifted from administrator to teacher, my re- 
lationshtp to the evaluation changed, formerly a close observer, I 
was now one of the evaluated, having- become a member of the teaching 
staff of the next undergraduate course. Vffiile continuing as program 
coordinator, I led a weekly two-hour discussion section In a course 
which focussed on problems of nations, with a multi-racial and/or 
multi-ethnic population. While performing the role of teacher, the 
evaluation had significant professional impacts upon me, predominantly 
upon the development of my skills as a teacher. 

Tfi^-|lis my first teaching experience and I was to benefit 
greatly fronijhe expertise of the evaluator. After what appeared to 
me to be an unsuccessful discussion section in the early weeks of 
the course, I approached the evaluator. He had observed my teaching 
sessions and indicated a willingness to make available to me data he 
had accumulated on teacher-student interactions in my discussion 
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sectton along with hfs tnterpretations of this data. Through this 
consultation, I came to better understand which of my teaching tech- 
niques and what in my teaching style proved effective, what ineffec- 
tive, and why. Utilizing video tapes of the class together with 
his personal observations, the evaluator pointed out things I had ' 
been doing in the classroom of which I was totally unaware. On nu- 
merous occasions, when either my authority or the accuracy of my po- 
sition on an academic issue was being challenged by a student, I 
would counter by assuming a highly-'i'ntGllectualized posture ~ citing 
scholarly theories in the defense of my position and presenting them 
in a rather esoteric vocabulary. Armed now with an awareness and a 
greater understanding of my teaching behavior and assured by the 
evaluator that despite certain weaknesses, I displayed strong abili- 
ties as a teacher, I was given the valuable criticism and encourag- 
ment that enabled me to develop my teaching skills. By the end of 
the course, the evaluation indicated vast improvement in the levels 
of learning and enjoyment experienced by both students and teacher 
in my discussion section. 

Serving in the capacity of consultant to the individual 
teachers and to the teaching staff as a whole, the evaluator proved 
an invaluable resource to a successful performance of the teaching 
function. The introduction by the evaluator of the findings of edu- 
cational researchers on a host of curriculum-related matters into 
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weekly staff meetings conducjted for preparation of the undergraduate 
course proved extremely useful in the construction of the curriculum. - 
And once the course was tn progress, the teaching staff benefitted 
from feedback of the evaluator's data on the students* reception of 
different kinds of lecture presentations, class formats, reading se- 
lections, and the use of audio-visual aids. We had almost instan- 
taneous Information on what was working well and what was not, and 
hence, the opportunity to make corrections;. 

But It was In my third role, as historian of the undergrad- 
uate program, that my Involvements with the evaluation was to have 
what I presently Judge to be the most profound and far-reaching set 
of Impacts, for it was while functioning as the historian on the 
evaluation team that I underwent both a confirmation of certain ideas 
and attitudes and significant changes in others which I held as an 
historian and an educator. These include an altered perspective on 
my discipline and on disciplinary-based education in general and changes 
which occurred when, acting as an historian, I was forced to make a 
reappraisal of my thinking on the nature of historical research, its 
assumptions, goals, and methods. In addition to this combination of 
disciplinary and intellectual impacts, there were professional ones 
as well. In doing the historical study, I was applying the assumptions 
and techniques of intellectual history to institutional history and in 
the process I developed new skills and refined others. These Impacts 
will reveal themselves as I describe why an undergraduate history was 
done and how It was done. 



ERIC 



6 



- 6 - 

In the Spring of 1973, Wht ton -Paine .v/as grappling with the 
problem of how, as an evaluator trained in psycfiology and educational 
research, he could arrive at an adequate account of both the histori- 
cal setting and the historical develo'pment of the program he was evalu- ' 
atlng. Not only was he not an historian, but the kind of historical 
research he envisioned required the services of someone with training 
In the history of Ideas. What, he wanted to know, was the original 

conception of the undergraduate program, how was it born, and what , 

were the factors which reshaped this idea, forcing It to undergo an 
evaluation into its present form? Since I was familiar with both the 
evaluation and the progrmm and I was trained as an intejlectu§l his- 
torla.i, I was a likely candidate to undertake the history. 

My task was to recreate the historical context of the under- 
graduate program with a focus upon its underlying assumptions and the 
transformations they had undergone. But the context of an educational 
program, I soon found, ms quite different frm the context of an idea, 
an intellectual figure, or an Intellectual circle, the usual focus of 
the historian of Ideas. University-based, the program's context was 
Institutional, and recreating this context took me Into a field of 
history with which I was totally unfamiliar — Institutional history.^ 
In addition to learning something about the nature and practice of - 
Institutional history, in undertaking the undergraduate project I was 
embarking upon a rather uncharted and little-developed area of study: 
the application of the techniques of the intellectual historian to 
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institutions rather than to their customary target of inquiry. 

My first major problan was to ,define the scope of the pro- 
gram's relevant institutional context. The Center for International 
Studies was the primary institutional focus of my study. Soon, how- 
ever, it became clear that the history of the undergraduate program 
required an ever-broadening context if one were to understand its evo- 
lution. The Center, itself had to be provided with a context if its 
institutional behavior was to be made comprehensible. An under-stand- 
ing of the university as an institution, Its organization into colleges 
and departments, and the functions of these structural components, be- 

r 

came essential If one were to make sense of the problems faced by the 
Center for International Studies in establishing and continuing an 
interdisciplinary academic program for undergraduates. Further, just 
why the undergraduate program should. have developed when it did, with 
its particular subject content and its particular format, required a 
broadening of the notion of context to include institutional inter- 
actions beyond the level of the university; thaf is, context had to 
take account of Interactions between institutions with which the uni- 
versity dealt — private foundations and the federal government. 

The focus on the evolution of an Idea as it is given insti- 
tutional expression required that I have recourse to a wholly new set 
of source materials than I had been accustomed to working with. Day- 
to-day memoranda and letters of CIS and university figures, minutes 
of meetings and university reports became my source materials. I de- 
•veloped an appreciation for archival research, something I must admit 
the historian of ideas very often lacks, as In my case, she surrounds 
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-.herself with the works of a few great thinkers. 

This first professional application of my historical train- 
ing became, in effect, a test and revision of implicit assumptions I 
held about the role that could be played by ideas. My research led 
me to the conclusion that the forces which shaped the formation and 
evolution of CIS' Undergraduate Program v/as a mix of factors that 
were in constant flux — the interaction of institutional constraints, 
ideas, and personalities. Taken al^jne, no single factor was determina- 
tive. Taken in conrtjination, at different points in time, different ' 
factors seemed more significant in effecting the outccwne of events 
than others. My research seoned to confirm In my mind the validity 
of ajheoretical and explanatory framework I "had adopted, as a graduate 
student — Max Weber's theories of historical cuasation and his method- 
ology of the social sciences. One could only speak in terms of "pro- 
bable" causes and "hypothetical" reconstructions. Events were the pro- 
duct of ^yriad of forces coexistent at any one point in time. Certain 
of these were more instrumental than others — these being "adequate" 
causes. The experience of doing the undergraduate program history 
further confirmed in my own mind that history was .far from being a 
science; recreation of events where human intentions played a major 
role was at best a creative exercise of the historian. And the histor- 
ian,- even when his source materials were primarily written documenta- 
tion, was still always the interpreter and mi the mere recorder of 
facts. Indeed, incchoosing what was the significant and what the Ir- 
relevant documentation, he was the maker of "facts". How sacrosanct, 
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then, were htstorical "facts", if they, too, were the products of 
interpretatton?^ 

In addition to leading me to undertake a reevaluation of 
my conception of history as a discipline, my involvements with the 
evaluation led me to rethink what I had for such a long time taken 
for granted and left unquestioned — the very structuring of know- 
ledge into disciplines and its transmission in this form* The under-, 
graduate program was an interdisciplinary enterprise, hence it raised 
this question for me from the start. 'First, as an outsider viewing 
an educational venture in an abstract way, as a purely intellectual 
problem;, then, when I, as a teacher, attempted, to impart knowledge 
to others, the problem became concrete and existential. A purely 
political or economic or historical approach to racial problems was 
at best partial. Teaching about racial domination as a solely po- 
litical or economic phenomenon was one way to approach the problem, 
^^ut It was just one angle* Political and economic analysis required 
supplementation by historical, anthropological, and psychological 
analysis. Problems in the social sciences and humanities are rarely 
open to solution by the application of knowledge from the perspective 
of one discipline alone. Problem-solving in these areas requires the 
decompartmentalization of knowledge, since problems of poverty and 
underdevelopment and an understanding of social and political movements 

are never purely political or economic phenomena. We are aware of 

^ 't 

the dangers of an uncritical use of language — how a word is merely 

f, 

used to name the thing, but soon usurps it. The word becomes reified. 
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as if it were in fact the reality. The tocl we employ to^ help us 
become better acquainted with reality becomes itself the reality. So, 
too, with a purely disciplinary 'approach^to knowledge.' The economic 
or social theory enlisted to aid us in our understanding of reality 
is viewed as the reality befoi^e us. Different disciplines become 
competing realities. 

As an instructor in the "undergraduate program, I learned 
that interdisciplinarity offers an alternate approach, and,, I believe, 
a more valid and valuable one. It pictures complementary realities 
where economic, anthropological, historical, psychological, ^Socio- 
logical interpretations exist side-by-side. — ft-offer^^^e possibility 
of an integrative interpretation, one drawing on the analytic tools 
and explanatory frameworks of all these perspictfv.es." 

In my role as the historian member of an interdisciplinary 
evaluation team, the value of interdisciplinary collaboration was 
further driven home to me. In discussing the. conclusions of my research 
with other members of the team, familiarization with their perspectives 
pointed up what I came to view as my improper weighting of significant 
factors that shaped the evolution of the undergraduate program . Trained 
.tn a discipline which emphasized the importance of a particular type 
of interconnection to events and a particular brand of analysis, I 
was insensitive to the role played by other forces. A more accurate 
history would require additional analysis from other perspectives. 

My involvements with the evaluation, then, resulted in a 
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variety of impacts. I belteve they can best be summarized with 
the statement that the experience has made me a better teacher and 
a better historian. If I am now an educator who has become more 
aware of the problematic nature of tiie- educational enterprise, I am 
also one with an awareness of how to attack some of the difficulties 
faced by one who seeks not simply to impart knowledge, but to provide 
students with a learning 'that is useful; that is, relevant to improv- 
ing their lives and the lives of others. I am convinced, as well, 
that there is great value to educational evaluation. As an under- 
graduate filling out questionnaires, I was convinced of this too; 
but at that time, I did not know quite why. 
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